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Abstract — In this paper, the design of irregular turbo codes for 
the binary erasure channel is investigated. An analytic expression 
of the erasure probability of punctured recursive systematic 
convolutional codes is derived. This exact expression will be 
used to track the density evolution of turbo codes over the 
erasure channel, that will allow for the design of capacity- 
approaching irregular turbo codes. Next, we propose a graph- 
optimal interleaver for irregular turbo codes. Simulation results 
for different coding rates is shown at the end. 

I. Introduction 

The performance of error correcting codes over the binary 
erasure channel (BEC) can be analyzed precisely, and a flurry 
of research papers have already addressed this issue. For small 
to medium codeword length, Maximum-Distance Separable 
(MDS) codes achieve the capacity of the BEC. However, for 
large block lengths, their decoding becomes untractable, and 
thus iteratively decoded graph-based codes present the main 
alternative. Low-density parity-check (LDPC) codes [1] [2] [3] 
and repeat-accumulate (RA) codes [4] with message-passing 
decoding proved to perform very close to the channel capacity 
with reasonable complexity. Moreover, "rateless" codes [5] [6] 
that are capable of generating an infinite sequence of parity 
symbols were proposed for the BEC. However, convolutional- 
based codes, that are widely used for Gaussian channels, are 
less investigated on the BEC. Among the few papers that 
deal with convolutional and turbo codes over the BEC are [7] 
[8] [9] [10]. In this paper, we propose irregular turbo codes 
that approach the capacity of the BEC for medium to large 
block length. This is accomplished through precise asymptotic 
analysis of the codes together with a graph-optimal interleaver. 
The paper is organized as follows: in Section|II]we describe the 
model of the irregular turbo code. Section lllil gives the exact 
erasure probability at the output of a punctured RSC code. The 
asymptotic design of irregular turbo codes is then discussed in 
Section [TV] while Section [V] presents an optimal graph-based 
interleaver for such codes. Section |VT1 shows the performance 
of these codes and Section rVHl gives the concluding remarks. 

II. Irregular turbo codes 

A parallel turbo code [11] generally consists of a concate- 
nation of two recursive systematic convolutional (RSC) codes. 
An information sequence b is encoded by the first RSC code 
to generate a first parity bit sequence; the same sequence is 
then scrambled by an interleaver n and encoded by a second 
RSC code to generate a second parity bit sequence. In most 
cases, the two constituent RSC encoders of a parallel turbo 
code are identical. For this reason, the authors in [12] [13] 



proposed a "self-concatenated" turbo encoder in which every 
information bit is repeated twice, interleaved, and fed to an 
RSC code of double the size, as shown in Fig. Q] In this 
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Fig. 1. Self-concatenated turbo encoder. 

new representation, each information bit is connected to the 
code trellis via two edges in the propagation tree of Fig. [2] 
Therefore, we say that the degree of the information bits is 
d = 2, and that the turbo code is regular. Using this structure, 
one can create irregularity by repeating a certain fraction fd 
of the bits d times, providing bits that are more protected than 
in the regular case. Like for LDPC and RA codes [2] [14], 
irregularity can boost the performance of turbo codes for large 
block lengths. Irregular turbo codes were first introduced in 
[15]. In [12] [13], in a slightly different design, a fraction of 
the information bits is repeated d times with d > 2, while 
the parity bits remained of degree 1 . In order to maintain the 
same coding rate, a fraction <\> v of the parity bits is punctured. 
We will use this representation to design irregular turbo codes 
for the binary erasure channel. The encoder of an irregular 
turbo code is similar to that of Fig. Q] with the difference that 
the repetition is non-uniform. The information bits are thus 
divided into d classes with d = 2, . . . , d max , where d max is the 
maximum bit-node degree. The number of bits in a class d 
is a fraction fd of the total number of information bits at the 
turbo encoder input, where bits in class d are repeated d times. 
Finally, the output of the non-uniform repeater is interleaved 
and fed to the RSC constituent code, of which (1 — p ) of the 
parity bits are transmitted. Now let K denote the length of 
the information sequence, N the interleaver size, po an d p the 
initial and the final (punctured) rate of the RSC constituent 
code respectively, and R c the rate of the turbo code. We can 
write the following: 

£ fd = h J2 d.f d = d, N = K J2 d.f d = K.d (1) 
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Fig. 2. Propagation tree of an irregular turbo code 



For a degree profile {/ 2 ,/3, — ,/dmax} and using the above 
equations, one can compute the puncturing fraction <f> p corre- 
sponding to a target rate R c . The performance of an irregular 
turbo code will strongly depend on the degree profile and the 
puncturing fraction or, more specifically, on the corresponding 
puncturing pattern. In the following sections we will consider 
the design of capacity-approaching irregular turbo codes over 
the BEC. To do so, we will first compute the analytic expres- 
sion of the extrinsic erasure probability at the output of the 
punctured RSC decoder that represents the key tool for the 
density evolution of irregular turbo codes. 

III. Erasure probability of punctured RSC codes 

In this section, we will derive the exact erasure probability 
of binary RSC codes, taking into account the puncturing of 
parity bits. To do so, we will follow the steps of the method 
proposed in [7] used to compute the erasure probability at the 
output unpunctured RSC codes. For the sake of simplicity, we 
only consider half -rate codes with constraint length L = v+1, 
where v is the memory of the code. The same method applies 
to RSC codes with different rates. 

We consider the following communication scheme: a uni- 
formly distributed sequence of bits b of length K is fed 
to a binary RSC encoder that generates a sequence c of 
parity bits of length 7V(1 — <ft p ). During transmissioro, a 
bit hi (respectively Cj) is either erased with probability p 
(respectively q), or perfectly received with probability 1 — p 
(respectively 1 — q). Let b' and c' be the received sequences 
at the decoder. An RSC code has S — 2 y states. Considering 
the "Forward-Backward" [16] decoding algorithm, let F n (s) 
and B n (s) be the probabilities of being in state s = 1, . . . , S 
computed in the forward and in the backward directions, at 
the left and at the right side of the n th trellis step respectively. 
Let /(e) and r(e) be the states to which an edge e is connected 

'We consider different erasure probabilities on information and parity 
bits, in order to be able to distinguish between the extrinsic (corresponding 
to information bits) and the communication (corresponding to parity bits) 
channels for the density evolution computation 



on the left and on the right respectively. The information bit 
b(e) and parity bit c(e) are associated to edge e. As shown 
in [7], the extrinsic probability of an information bit b n at the 
output of the decoder is written as: 



-Pcxt(bn) 



/n-1 u /oo A 

n + l. c J 

]T F n (l(e)) ■ P(c(e)) ■ B n (r(e)) 

e:6(e) = b„ 



(4) 



ISj^h 



= {crj,. ..,cr^ F| } and S s 
. ,a b } be the sets from which F n and B n take 
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values. The cardinality of the sets T,p and Y,b is computed 
as: 

f7f*\ 

\2 V > 



|£ f | = |£bI = E 



(5) 



However, as an RSC code is linear, we assume the all-zeros 
codeword is transmitted without losing generality. This gives 
smaller state distribution sets Y>* F and Y,* B with cardinality: 



A four-state RSC code (L = 3) has for instance: 

KJ, = T* B = {(1,0, 0,0), (1/2, 1/2, 0,0), (1/2,0,1/2,0), 
(1/2, 0, 0, 1/2), (1/4, 1/4, 1/4, 1/4)} 



(7) 



A. Computation of the Erasure Probability 

The trellis of a convolutional code forms two first-order 
5-state Markov chains corresponding to the forward and 
backward recursions. This allows to compute the steady-state 
distributions of the Markov processes that will be used to com- 
pute the bit erasure probability at the output of the decoder. 
The distributions iip (p, q) and ttb (p, q) are the normalized 
solutions of the following equations: 

i"f(p, 9) = K F (p,q) ■ M F (p,q); ir B (p, q) = K B {p, q) ■ M B {p, q) (8) 

where the (i, j) th entry of matrix Mp is the probability of the 
transition from state distribution F n = a\ to state distribution 
Fn+i — f"f ■ Similarly, the matrix Mb represents the transition 
probabilities in the backward direction. In other words, the 
distributions irp and ttb are the stationary distributions to 
which the Markovian process converges, as: 



lim M 
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I TTB 



(9) 



where 1 is a column vector of ones. As an example, we will 
consider the four-state RSC (l,5/7)s code with L = 3. Let 
p be the erasure probability on the information bits, and q be 
the erasure probability on parity bits. Assuming the all-zeros 
codeword has been transmitted, we have that |EJ^| = |E^| = 
5. The 5x5 Markov state transition matrix Alp for the forward 
recursion of this code is given by: 

M F (p,q) = 



1-pq 
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and the matrix Mb for the backward recursion is given by: 

M B (p,q) = 



i -pq 

+ pq-p- 
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Once Mp(p,q) and Ms(p,g) are computed, we can solve 
for ttf(p,<1) and TTg(p,q). We next consider the matrix T(q) 
whose (i, j) th entry represents the probability of an output 
erasure conditioned on the left and right state distributions o\ 
and a J b , knowing that parity bits are erased with probability q: 



Ti,j(q) = P (Pext(fcn) = 1/2 | F„ = a),B n = <xjQ (10) 

The matrix T(q) for the RSC (1, 5/7) 8 code is given by: 



T(q) 



q 

q q q q q 

1 q 1 

<? 1 1 

q 1 g 1 1 



Finally the extrinsic erasure probability is computed as: 

P**b(p,q) = 1TF-(p,q)-T(q)-ir B (p,q) t (11) 

where the operator (.)* denotes the transpose operator. 

B. Computation of the Erasure Probability with puncturing 

Now suppose a fraction (f> p of the parity bits of the code are 
punctured. If the punctured parity bits were randomly chosen 
at each transmission, we could consider that the fraction <fi p 
of punctured bits is a part of the channel, as if the decoder 
receives bits with probability of erasure on parity bits given 
by: 

q' = l-(l-q)(l-(t> p ) = (f> p + q-q-^ p (12) 

However, if the puncturing pattern is fixed, the extrinsic 
erasure probability computed using (fTTT > by replacing q with 
q 1 from (TTZl i is inaccurate. The goal is then to analytically 
compute the extrinsic erasure probability at the output of 
the decoder knowing that parity bits are punctured using a 
predefined pattern. For this purpose, we define a puncturing 
pattern X = [x\,X2, ..., xr], x 1 £ {0, 1}, where a in position 
7 means that the parity bit in the corresponding trellis step is 
punctured. The parity bits of the constituent RSC code are then 
punctured using a periodic puncturing pattern with period X. 
We consider a window of size Y in the trellis of the code, and 
let Mp,x(p, q) the matrix whose (i, j) th entry is the probability 



of the transition from the state distribution F n 



a} at the 



/ 



left side of the window to the state distribution F„_|_r = cr 
at the right side of the window. Similarly, the matrix Mb; 
represents "throughout-the-window" transition probabilities in 
the backward direction. We have the following: 

r r 

M F ,x{p,q) = EI M F{p,q x ~<)\ M BlX (p,q) = II MB&q^+i-y) 



7 = 1 



7=1 



(13) 



This means that MF,x(p,q) is obtained by multiplying 
matrices Mf(p, 1) and Mp(p,q) according to whether the 



corresponding parity bit is punctured (x 7 = 0) or not (x 7 = 1). 
A similar assertion holds for the backward matrix Mb,x(p, q)- 
Let ttf,x{p, q) and ttb,x(p, q) be the corresponding steady- 
state distributions, meaning that: 
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(14) 



where 1 is a column vector of ones. These expressions 
represent the state probability distributions in the forward and 
backward directions, at the left and at the right side of the 
window respectively. The distributions TTF n (p,q) on the left 
side and 7i\B. 7 (p, q) on the right side of a window step 7 can 
be recursively computed as: 

kf,i{p, q) = -^F,j,(p,q), 

7T Fr/ (p,q) = 7T Fr/ _ 1 (p,q)-M F (p,q x -'), 7 = 2, . . . ,T (15) 

TB,r(j»9) = n B ,%{p, q), 

^B,j(p,q) = ir B , J+1 (p,q)-M B (p,q x -<), 7 = T - 1, . . . , 1(16) 

Next, the extrinsic erasure probability of the information bit 
in position 7 can be computed as: 



■Pext, 7 (p,9) = K P ^{p,q) ■ T(q x -<) ■ 7r s , 7 (p,g)* 



(17) 



Finally, the extrinsic erasure probability at the output of the 
decoder corresponding to the puncturing pattern X is given 
by: 



Pext,x(p,q) = - Yl p ext, 7 (p,g) 



(18) 



7 =0 



As an example, suppose we want to construct a half-rate 
parallel turbo code using half-rate (l,5/7)s RSC codes. In 
order to raise the rate of the constituent codes from 1/2 to 
2/3, we puncture half of their parity bits using the pattern 
X = [1,0]. The expression of the exact probability of this 
code can then be written as: 



-Pext,x(p,<?) = - [Pext,l(P,q) + -Pext,2(p,g) 



(19) 



where 



Pext.i = ■^F,x(p,q)-T(q)-[K Bt% ip,q)-M B {p,l)] i (20) 
Pext,2 = [KF,x(p,q)-M F (p,q)] ■T(l)-7r Si x(p,<?) t (21) 



""f.xCp, q) 
m f,x(p, q) 

^B,%(p,q) 
m b ,-k{p, q) 
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'* ■ lim M FX (p,q), and 

S — 'OO ' 

M F (p,q)-M F (p,l) (22) 

i-1*- lim M s B% (p,q), and 

O a — >oo 

M B (p,l)-M B (p,q) (23) 



The exact expression of the erasure probability in (TT~8T > is 
the key tool for designing irregular turbo codes for the BEC, 
as will be discussed in the following section. In fact, for 
the same puncturing fraction (f> p , it is capable of determining 
which pattern X gives the lowest P e xt.x- Moreover, it allows to 
detect a catastrophic puncturing scenario that leads to infinite 
error events and thus harms the correction capacity of the 
code. As an example, puncturing the RSC (1, 5/7)s code using 
X= [1,0,0] gives: 



P:xt,x(0,g)>u 



(24) 



Pl+i(d) =p • 



This means that this puncturing pattern is catastrophic, as 
a single bit error at the input of the decoder generates an 
infinite error event. If we have <fi p = 2/3, we would rather 
use X = [1,0,0,0,1,0] for instance. Although this example 
can be directly observed on the trellis of the (l,5/7)s code, 
([T"8l points out the phenomenon for any S*-state code (on any 
channel!), where trellis analysis becomes more tedious as S 
increases. 

IV. Irregular turbo code design 

The analytic expression of the erasure probability of punc- 
tured RSC codes in the previous section allows us to analyze 
the iterative decoding of turbo codes over the BEC. As dis- 
cussed in Section |II] a parallel turbo code consists of a parallel 
concatenation of two RSC codes. The iterative decoding of 
such codes can be analyzed through EXIT charts [17], that 
are non-linear functions relating the output to the input of the 
RSC decoders of the infinite-length turbo code. This technique 
gives insight on the iterative process in the sense that the 
decoding is successful for a certain channel quality if the two 
curves corresponding to the two decoders do not intersect. 
The threshold of the code is the worst value of the channel 
quality at which the tunnel between the two curves is open. In 
the case where the two constituent codes are identical, the 
decoding converges if the curve of the RSC decoder does 
not intersect with the forty-five degree line. Over the BEC, 
and with the difference of Gaussian channels in general, an 
EXIT chart describing the iterative decoding process gives 
the exact density evolution of erasure probabilities, as we can 
compute analytic expressions of the output as a function of the 
input of the decoder. Although widely used for LDPC codes, 
this property was first exploited in [18] to compute exact 
thresholds for regular unpunctured turbo codes. For the sake 
of infinite-length analysis, we represent a turbo code using the 
tree structure as shown in Fig. in which an information bit 
of degree d is connected to d trellises. For the regular parallel 
turbo code, the erasure probability at iteration £ + 1 is given 
by: 



Pi+l = Po ■ P;xt,X (Pe,Po) 



(25) 



where pq is the channel erasure probability. This expression 
determines the density evolution of the iterative decoding 
process, as it relates the probability at an iteration to that of 
the previous iteration. Using d25l l. the threshold probability 
p± of the R c — 1/3 parallel turbo code built from rate-half 
RSC (1, 5/7)8 constituent codes is computed as p t h = 0.6428, 
knowing that the capacity of the BEC is C = 1 — po- Again, 
the punctured R c = 1/2 turbo code built from the same 
constituent codes has p^ — 0.4729. 

In order to tighten the gap to the capacity of the BEC at 
a given rate, we consider the design of irregular turbo codes. 
The erasure probability at iteration £ + 1 of a bit of degree 
d can be expressed as a function of the erasure probability at 
iteration £ as: 



^■Pext,x(P^P0) d - 1 
a 



(26) 



Let \ d = -M and \{X) 



dmax 

E 



XdX*- 1 



(this definition 



will be made clearer in Section [V] where we will introduce 
the factor graph of the turbo code). We can then write: 

Po-A d -P ext , x (P,,p ) d_1 



Pe+i(d) 
Averaging over all possible bit degrees, we get: 

P e+ i = po ■ A o Pext.x (Pe,po) 



(27) 



(28) 



Following this equation, the irregular turbo code can recover 
from a channel erasure probability po if and only if 



PO ■ Xo Pext.X (x,Po) <X, Vz € [0,p ] 

The code threshold is defined as: 



(29) 



p th (A,X) = max{p \p ■ Xo P ex t,x (%,Po) <%, Vie [0,po]} (30) 

and it depends on both degree distribution and puncturing 
pattern. The design of capacity approaching irregular turbo 
codes reduces to the optimization of the function (A, X) h^ 
p t h(A,X). For instance, this can be carried out using the 
differential evolution algorithm [19]. In general, a uniform 
puncturing pattern leads to the best threshold, provided the 
pattern is not catastrophic (which leads to a threshold equal to 
zero!). Therefore, in order to reduce the space of parameters 
of the optimization function, for each degree distribution A, 
we compute the puncturing fraction <\> v according to the target 
rate R c , and chose the puncturing pattern X as uniform as 
possible according to <f> p . As an example, using the half-rate 
RSC (1,5/7)8 code and by setting <i max = 12, we obtained 
the degree profiles in Table U 

TABLE I 
Degree profile of irregular turbo codes over the BEC 
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4>p 


Vth 


1/2 


0.801 


0.101 






0.046 




0.052 


2.998 


0.666 


0.490 


1/3 


0.838 




0.034 


0.041 


0.042 


0.045 




2.873 


0.304 


0.665 


1/4 


0.837 




0.055 




0.054 




0.054 


3.033 


0.011 


0.743 



Note that the half-rate irregular turbo code designed through 
differential evolution has 2 parity bits out of 3 punctured, and 
the optimization algorithm avoided catastrophic puncturing 
while computing ( fT8b . as explained at the end of Section [III] 

V. PEG-BASED INTERLEAVER FOR TURBO CODES 

We investigate now the design of graph-based interleavers 
for irregular turbo codes based on the progressive-edge growth 
(PEG) algorithm [20]. To do so, we define the factor graph of 
an irregular turbo code, in a manner similar to that of [21], 
[22]. As shown in Fig. [3] the factor graph consists of: 

• bit nodes, represented by simple circles (information 
bits are represented on the top, while parity bits are 
represented on the bottom); 

• state nodes, represented by double circles; 



« trellis step nodes, also called transition nodes, represented 
by squares. 

If po = k/n is the rate of the constituent RSC codes, then each 
transition node is connected to k information bits and n — k 
parity bits. Using this representation, the previously defined 

Xd = — = — is equal to the fraction of edges emanating from 
d 

is 



information bit nodes of degree d, and A = (A2 
called the edge perspective degree distribution. 



1 An 



Interleaver tt 





Fig. 3. Factor graph of irregular turbo codes. 

The decoding of turbo codes can be performed on the factor 
graph, by iteratively propagating extrinsic messages from each 
graph node to its neighbor nodes. As discussed in [23] [22] 
[24], small cycles must be avoided in the factor graph of 
a turbo code so that it looks locally tree-like, and thus the 
messages are more independent. An upper-bound on the girth 
(minimal cycle length) of an irregular factor graph can be 
derived using a straightforward variation of the approach in 
[25] (see also Lemma 2 in [20]): 



ff<4 



1 °g[(^- 1 )^2+ 1 ] 



log(fc + 1) 



+ 1 



(3D 



Thus, a graph-optimal interleaving algorithm for irregular 
turbo codes would yield factor graphs with girths that grow 
as the logarithm of the interleaver size. Graphs with large 
girths have been already used for the construction of regular 
turbo codes [22] and LDPC codes [20]. The Progressive Edge 
Growth algorithm proposed in [20] is based on a simple 
but very efficient idea: it progressively establishes "best- 
effort" connections in the graph, where a best-effort connection 
corresponds to an edge maximizing the graph girth. In what 
follows, we extend this construction to the case of irregular 
turbo codes. The corresponding interleaver will be called PEG 
interleaver. 

The algorithm is submitted with the set B = {b\, • • • , 6rt} 
of information bit nodes, the set T = {ti, ■ ■ ■ ,ijv} of transi- 
tion nodes, and a desired information bit degree distribution. 
According to the submitted distribution, we can write B as 
a disjoint union B = UJ^Bd, where Bd is be the set of 
information bits with submitted degree d. The algorithm starts 
with a factor graph comprising the set B of information bit 
nodes, the set T of transition nodes and the corresponding 
set of state nodes, each transition node being connected to 
its left and right state nodes. At this moment there is no 
connection between information bit and transition nodes. We 
then progressively add edges emanating from bits in the set 
B2, until all these bits reach the submitted degree 2. We next 
progressively connect the bits from the sets B3, ... , Bd max . It 



is important to notice that no bit of Bd is connected, as long as 
there are bits in Bd-i that do not reach the submitted degree 
{d — 1). This is done in order to protect the bits of small 
degree in the following sens: when information bits of small 
degree (e.g. d = 2) are connected, the graph girth is relatively 
large; this will help to avoid short cycles that contain only 
information bit nodes of small degree. Adding more edges 
in the graph, the girth will decrease. When information bit 
nodes of higher degree are connected, we get smaller cycles, 
but these cycles are better connected to other cycles in the 
graph. To connect bit nodes in Bd we proceed as follows: 

Progressive Edge Growth for Bd 

for i = 1, . . . ,d 
for each b £ Bd 



if i = ,1 
~hi 



else 



Choose a transition node t of lowest degree in the current graph 
and connect b to t 

Expand the current graph as a tree rooted at b, until all transition 
nodes are in the tree. Identify transition nodes that are connected 
to at most k — 1 information bits in the current graph. Among 
these transition nodes, identify those of maximal depth in the 
tree. Among these last identified transition nodes, choose a 
transition node t of lowest degree in the current graph and 
connect b to t 



end 
end 

end 

Note that, we first add an edge for each bit in Bd, then a 
second edge for each bit, and so on, until all bits reach the 
degree d. 

In case that the puncturing pattern is known at the time of 
the interleaver construction, we can use a slightly modified 
version of the above algorithm as follows: first, each bit b G 
B is connected to an unpunctured transition node of lowest 
degree in the current graph (we say that a transition node 
is unpunctured if its parity bit is unpunctured). In case that 
the number of unpunctured transition nodes is less than the 
number of information bit nodes, we connect the information 
bits of smallest submitted degree. Finally, the interleaver is 
constructed by running the above PEG algorithm, but starting 
from this graph. In this way, we make sure that if the number 
of unpunctured transition nodes is greater than the number of 
information bit nodes, then any information bit is connected 
to at least an unpunctured transition node. 

Now that we have constructed the PEG-based interleaver, 
we can derive a lower-bound of the girth of the corresponding 
factor graph. Similar to the proof of Theorem 1 in [20], we 
can easily show that: 



a>2 



log [N(k + 2) (l 



1 
dmax , 



■N- 



log[(<W-l)(fc + l)] 



- 1 



(32) 



Otherwise formulated, the girth of an irregular PEG inter- 
leaved factor graph increases with the logarithm of the in- 
terleaver size, which is optimal according to (l3TT l. 

Over the BEC, the performance under iterative decoding is 
determined by the minimum stopping set [1] [9] of the factor 
graph of the code, the size of which is upper-bounded by its 
minimum distance. As this minimum stopping set is in general 
related to the girth of a factor graph [26], we would expect its 



size increases with the girth. Moreover, the minimum distance 
of a turbo code grows logarithmically with the interleaver size 
[24] . The rate of growth of the minimum stopping set of turbo 
codes under PEG-based interleaving would thus be optimal. 

VI. Simulation results 

In this section, frame error rate performance of irregular 
turbo codes over the BEC is shown. Although the analysis 
so far is based on the BCJR algorithm that supposes soft 
information exchange, it was shown in [8] that a hard-input 
hard-output (HIHO) decoding algorithm (namely the Viterbi 
algorithm [27]) for convolutional codes is optimal in terms of 
bit error probability over the BEC. For this reason, we will use 
a HIHO decoding algorithm for irregular turbo codes inspired 
by the algorithm in [28] for LDPC codes, in that it propagates 
in the trellis of the turbo code by removing transitions in 
the same way edges are removed in a bipartite graph under 
message-passing decoding [29]. This decoding scheme ensures 
a decoding complexity linear in the interleaver size. Codes 
from Table [I] although having very high thresholds, suffer 
from high error floors (> 10~ 2 ). However, they are well suited 
for applications for which the quality criterion is the average 
inefficiency [29]. Fig. |4] shows the performance of irregular 
turbo codes having a good threshold-error floor tradeoff. In 
order to avoid high error floors, the 8-state RSC (1, 15/13)g 
code was used as the constituent code of the irregular turbo 
code. At a target frame error rate of about 10~ 3 , irregular 
turbo codes are within 0.018 < A p < 0.028 from capacity for 
various coding rates. 
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Fig. 4. Performance of irregular turbo codes over the BEC. 

VII. Conclusions 

We proposed irregular turbo codes that perform close to 
capacity for the binary erasure channel. The codes operate 
for various coding rates, and they provide low error floors 
with a PEG-based interleaver that maximizes the cycles in 
the graphical representation of the code. Implemented with 
an "on-the-fly" hard-input hard-output decoding algorithm, we 
believe that these codes are suited for software implementation 
in upper-layer forward error correction (UL-FEC) contexts. 
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